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(57) In order to freely select, locate and display an 
image from a remote place on a monitor to facilitate ob- 
server's use, disclosed are apparatus and methods ar- 
ranged to perform operation of drag and drop of a sym- 
bol to a specific position on a map showing the symbol 
indicating information of the position where an image 
generator is set, thereby establishing logical network 
connection with a video transmission terminal to which 
the image generator is connected, to display a video in 
an arbitrary display area, to perform the drag and drop 
operation of the video displayed in the video display ar- 
ea to another video display area, thereby changing a 
video display position, and to perform the drag and drop 
operation thereof to a display stop symbol, thereby dis- 
connecting the logical network connection to stop the 
video display of the video camera. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a communication 
apparatus and method and to an image processing ap- 
paratus and method. 



Related Background Art 

A monitoring apparatus as an example of such com- 
munication apparatus is composed of several video 
cameras, a composer for performing analog synthesis 
of videos therefrom, and a device called a switcher for 
enabling selection thereof. Such apparatus are mainly 
used in relatively small buildings and are called local 
monitoring systems. In contrast with the local monitoring 
systems, recently being developed are remote monitor- 
ing systems which use a digital network such as LAN or 
ISDN instead of analog cables as video transmission 
lines, thereby permitting substantial extension of trans- 
mission lines. 

Camera control systems permitting remote control 
of one or plural monitoring cameras from a remote place 
are well known. Each monitoring camera is one fixed, 
on a stage as being always directed in one direction or 
one permitting external control of pan, tilt, and zoom. 
The latter camera usually incorporates a function to re- 
motely control the taking direction and magnification 
from a monitoring center. 

When a plurality of cameras are remotely control- 
led, it is necessary to indicate locations and orientations 
of the respective cameras for an operator. For example, 
proposed as a monitoring system with many cameras 
set in a shop, a plant, or a building arranged to remotely 
control them is a camera information display system for 
displaying graphics (camera icons) indicating the cam- 
eras at positions corresponding to the setting positions 
of the respective cameras. 

Among the recent monitoring systems there are 
some reported systems utilizing an IBM PC compatible 
(PC) as a monitoring terminal and realizing video display 
and system control with Graphical User Interface (GUI). 
Use of GUI with a computer as a monitoring apparatus 
presents an advantage of ease to handle even for peo- 
ple unaccustomed to the apparatus. 

However, the conventional systems of this type use 
the digital network as video transmission lines, but show 
analog display on the monitor. Thus, the display posi- 
tions of video camera images strongly depend upon the 
hardware of system. Therefore, since the display posi- 
tions of video camera images are fixedly assigned to a 
video display section on a specific monitoring terminal 
upon introduction of system, an observer being a user 
cannot freely rearrange the video display position in or- 
der to make them easier to handle or cannot select the 



video camera images which are merely displayed. 

A concern of the present invention is to provide a 
communication apparatus and method easy to use, tak- 
ing account of the foregoing points. 

5 Another concern of the present invention is to real- 
ize easy line connection with a desired terminal. 

A further concern of the present invention is to re- 
alize easy-to-view observation of received images from 
image generating apparatus. 

10 A preferred embodiment of the present invention 
discloses an "arrangement in which upon displaying re- 
ceived image data from an image transmitting terminal 
on a monitor, network connection with the foregoing ter- 
minal is performed based on a display instruction on the 

15 monitor as to the received image data from the terminal. 
Further disclosed is an image processing apparatus 
having means for supplying a video signal to a monitor 
to display a map indicating a setting condition of image 
pickup means, means for displaying a symbol indicating 

20 a location of the foregoing image pickup means on the 
map, and control means for displaying an image signal 
from the image pickup means on the monitor in accord- 
ance with drag and drop of the symbol on the map. 
Other advantages and features of the present in- 

25 vention will be apparent from the following description 
and the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 Fig. 1 is a block diagram of video transmitting ter- 
minal and monitoring terminal in an embodiment of the 
present invention. 

Fig. 2 is a block diagram of software in an embodi- 
ment of the present invention. 
35 Fig. 3 is a screen example of the embodiment. 

Fig. 4 is a drawing to show a screen after switch of 
map to 530. 

Fig. 5 is a drawing to show an example of video dis- 
play window 600 of the embodiment. 
40 Fig. 6 is a drawing to show the state upon execution 
of display by D & D operation. 

Fig. 7 is a drawing to show an example of the shape 
of mouse cursor upon D & D operation. 

Fig. 8 is a drawing to show the state upon change 
45 of video display area by D & D operation. 

Fig. 9 is a drawing to show a display example of 
camera icon under video display. 

Fig. 1 0 is a drawing to show the state upon execu- 
tion of video display stop by D & D operation. 
so Fig. 11 is a flowchart to show the operation of the 
entire apparatus of the present embodiment. 

Fig. 12 is a flowchart to show the operation of the 
entire apparatus of the present embodiment. 

Fig. 1 3 is a flowchart to show the operation of the 
55 entire apparatus of the present embodiment. 

Fig. 14 is a flowchart to show the details of display 
process routine in S110 shown in Fig. 11. 

Fig. 15 is a flowchart to show the details of display 
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process routine in S110 shown in Fig. 11. 

Fig. 16 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11. 

Fig. 1 7 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11. 

Fig. 18 is a flowchart to show the configuration of 
camera control client shown in Fig. 2. 

Fig. 19 is a flowchart to show the details of display 
process routine in S1 1 0 shown in Fig. 1 1 , in Embodiment 
2. 

Fig. 20 is a flowchart to show the details of display 
process routine in S11 0 shown in Fig. 1 1 , in Embodiment 

2. 

Fig. 21 is a flowchart to show the details of start rou- 
tine of display movement and stop process in Si 18 
shown in Fig. 11, in Embodiment 2. 

Fig. 22 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11, in Embodiment 2. 

Fig. 23 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11, in Embodiment 2. 

Fig. 24 is a flowchart to show the details of display 
process routine in S11 0 shown in Fig. 1 1 , in Embodiment 
3. 

Fig. 25 is a flowchart to show the details of display 
process routine in S11 0 shown in Fig. 1 1 , in Embodiment 

3. 

Fig. 26 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11, in Embodiment 3. 

Fig. 27 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11, in Embodiment 3. 

Fig. 28 is a flowchart to show the details of start rou- 
tine of display movement and stop process in S118 
shown in Fig. 11, in Embodiment 3. 

Fig. 29 is a block diagram to show a video commu- 
nication terminal apparatus (video transmission-recep- 
tion apparatus) according to another embodiment of the 
present invention. 

Fig. 30 is a schematic view to illustrate a screen for 
displaying an image from a video transmission appara- 
tus to which a plurality of cameras are connected. 

Fig. 31 is a block diagram to show a video commu- 
nication terminal apparatus in which a camera input 
composer is included. 

Fig. 32 is a schematic view to illustrate a screen for 
displaying an image from the video transmission appa- 
ratus in which the camera input composer is included 
and to which the plurality of cameras are connected. 

Fig. 33 is a schematic view to illustrate a screen for 
displaying a composite image from the video transmis- 
sion apparatus in which the camera input composer is 
included and to which the plurality of cameras are con- 
nected. 
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Fig. 34 is a block diagram to show the configuration 
of a network according to another embodiment of the 
present invention. 

Fig. 35 is a block diagram to show the configuration 
s of software according to the embodiment of the present 
invention. 

Fig. 36 is a plan view to illustrate a camera display 
control panel which is displayed by a monitoring appa- 
ratus according to the present invention. 
10 Fig. 37 is a drawing to show a camera icon repre- 
senting a camera that cannot be controlled. 

Fig. 38 is a drawing to show a camera icon repre- 
senting a plurality of cameras connected to the same 
host. 

is Fig. 39 is a drawing to show a camera icon repre- 
senting a camera connected to the camera input com- 
poser. 

Fig. 40 is a plan view to illustrate a camera display 
control panel, including a composite image, which panel 
20 js displayed by the monitoring apparatus. 

Fig. 41 is a partially enlarged view to show part of 
the composite image shown in Fig. 40. 

DESCRIPTION OF THE PREFERRED 
25 EMBODIMENTS 

(Embodiment 1 ) 

Embodiment 1 of the present invention will be de- 
30 scribed in detail with reference to the drawings. 

Fig. 1 is a block diagram of the whole system includ- 
ing video transmitting terminals and a monitoring termi- 
nal. 

A video transmitting terminal 20 shown in Fig. 1 is 

35 used together with an example of an image signal gen- 
erating apparatus, in the present embodiment a video 
camera 60. Terminal 20 receives a camera control sig- 
nal from a camera control terminal 1 2 to control the vid- 
eo camera, and also performs A/D conversion and data 

40 compression of video signals from the video camera to 
transmit obtained data in this manner to the network. 

In Fig. 1, reference numeral 10 designates a video 
camera, and 1 2 a camera control circuit for directly con- 
trolling pan, tilt, zoom, focusing, aperture, and so on of 

45 the video camera 1 0 in accordance with an external con- 
trol signal. The external control signal is input from an 
interface provided by RS-232C, for example. 

The camera control circuit 12 does not always have 
to be provided in the case of the video camera 10 inca- 

50 pable of controlling pan, tilt, etc., but the control circuit 
12 may be arranged to perform on/off control of power 
supply of video camera 10. Numeral 20 denotes a com- 
puter for controlling the video camera 1 0 connected to 
the camera control circuit 12 by sending a control code 

55 to the camera control circuit 1 2 and for transmitting vid- 
eo data obtained from the video camera 10. through a 
network interface 38 to the network. For example, it is 
conceivably a work station (WS) or a personal computer 



3 



<EP 0781049A2_I_> 



c c 

5 EP 0 781 049 A2 6 



(PC). 

Next described is the configuration of the computer 
20 in the present embodiment. Numeral 22 represents 
a CPU for controlling the entire system, 24 a main mem- 
ory, 26 a secondary memory unit such as a hard disc s 
unit, and 28 a mouse as a designating device, which, 
without having to be limited to the mouse, may be an- 
other device in the present invention, for example, a 
touch panel on a display 35. Numeral 30 is a keyboard. 
Numeral 25 denotes a removable external memory unit . IP 
such as a floppy disc or a CDROM, and the software of 
this system may be read out of these media or the net- 
work interface 38 to be stored in the secondary memory 
unit 26. Numeral 32 is an I/O board connected to the 
camera control circuit 12 for transmitting and receiving 
the camera control signal, and 34 a video capture board 
tor capturing a video output signal VD from the video 
camera 10. The video output signal may be either ana- 
log as in NTSC or digital, but in the analog case posses- 
sion of a function to perform A/D conversion is required. 
The video capture board 34 does not have to include a 
data compression function, but without the compression 
function, execution of software compression is rather 
desired. The captured video is output from the board 34 
through a bus 39 to the video board 36 to be displayed 
at an arbitrary position on the bit map display 35. Such 
control of display position is carried out when the CPU 
22 gives an instruct ion of display position and position 
or area to the video board 36- Numeral 39 is a system 
bus for connecting the devices of from CPU 22 to net- 
work interface 38 with each other. 

The above configuration permits the terminal 20 to 
transmit a video signal via the network 1 00 to the mon- 
itoring terminal at a remote place, to receive the camera 
control signal from the monitoring terminal, and to per- 
form the camera control. Numeral 60 indicates the sche- 
matic configuration of the monitoring terminal (video re- 
ceiving terminal). The monitoring terminal 60 sends a 
control signal for video camera 10 to the video transmit- 
ting terminal 20, and the video transmitting terminal 20 
controls the video camera in accordance with such a 
control signal and sends the status of video camera 1 0 
obtained as a result back to the monitoring terminal 60. 
The monitoring terminal 60 displays the status of the 
pertinent video camera on a display unit, for example, 
on a bit map display 1 35. Further, the monitoring termi- 
nal 60 receives video data sent from the video transmit- 
ting terminal 20, expands the compressed data by soft- 
ware, i.e., decodes the coded data, and displays the 
thus decoded data on the display unit in real time. As 
seen from the drawing, the monitoring terminal 60 has 
the same configuration as that attained by excluding the 
video camera 10, camera control unit 12, and capture 
board 34 from the video transmitting terminal 20, and 
elements having the same functions as those in the ter- 
minal 20 are denoted by reference numerals with addi- 
tion of "100" to those in the terminal 20. Of course, they 
do not necessarily have to be excluded in particular. If 



expansion of compressed data takes too much time be- 
cause of insufficient performance of CPU 1 22, extended 
hardware with a compression-expanding function may 
be added. 

The above configuration permits the terminal 60 to 
receive the video from the video transmitting terminal 
20 at a remote place via the network 100, to perform 
expansion of compressed data, to display the video at 
an arbitrary place on the bit map display 1 35, i.e. , on the 
monitor displaying unit, and to transmit a video camera 
control code according to a control instruction of video 
camera input through the keyboard 130 or mouse 128 
by the operator, to the video transmitting terminal. 

Fig. 2 is a drawing to show the software configura- 
tion of the present embodiment. Software 410 of the 
monitoring terminal 60 and software 420 of plural video 
communication terminals 20 and the like is connected 
to the network 100, and installed in the software 410 of 
the monitoring terminal is camera control client 411 for 
remote-controlling cameras each connected to the soft- 
ware 420 of video communication terminals on the net- 
work, video reception software 41 2 for expanding com- 
pressed video data sent in the form of packet from the 
video communication terminal and displaying the ex- 
panded data, and map management software 41 3 hav- 
ing a GUI capable of graphically displaying a map, a 
camera symbol, positions of cameras by scope display 
of Fig. 6 as detailed hereinafter, and pan and zoom and 
performing camera control. The video reception soft- 
ware 412 is software playing a main role for performing 
management of cameras of the all video transmitting ter- 
minals connected to the network 100, which retains 
camera names of the respective cameras, host names 
of the computers to which the cameras are connected, 
information about the cameras including the camera 
status of pan/tilt, zoom, and the like and about whether 
they are controllable or not, and information indicating 
the present status about which camera is under control 
at present and a video of which camera is under display. 
The camera control client 411 and map management 
software 41 3 also shares these information to utilize it 
for display change of camera symbol or the like. Numer- 
al 421 is software for controlling the conditions of cam- 
era including pan/tilt, zoom, white balance, and so on 
for the camera connected to such a terminal and for stor- 
ing the video data output from the camera, which is 
called a camera control server. Numeral 422 designates 
software working together with the video reception soft- 
ware. 

Fig. 3 shows an example of the screen displayed 
on the bit map display 135 of the monitoring terminal 
410. Numeral 500 represents a map window, in which a 
plurality of maps 520, 530, 540, — , each indicating a 
layout of an office, a shop, or a warehouse, are man- 
aged in the present embodiment. There is no specific 
limitations on the number of maps, which can be deter- 
mined depending upon the performance of system. A 
tag is attached to each map, and by clicking this tag with 
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a mouse pointer, a map with the pertinent tag is dis- 
played on a map display area 502 At the same as it, 
camera symbols are also displayed as being positioned 
on the pertinent map. Fig. 3 shows a state in which the 
map 520 among the maps 510 to 540 is displayed on 
the map display area 502 and in which camera icons 
521 , 522, 523, ... located on the map 520 are displayed. 
Here, with clicking the tag of map 530. the map 530 is 
displayed on the map display area 502 as shown in Fig. 
4, and at the same time : camera icons 531 , 532, 533, ... 
located on the map 530 are displayed. Fig. 5 is a drawing 
to show a window 600 to display input video signals, and 
this Fig. S shows an example in which the video signals 
received through the network 100 are displayed in re- 
spective windows. 

In Fig. 5 numeral 600 designates a video display 
window, and areas 610, 612, 614, 616, 618, 620, ... in 
the video display window are video display areas. There 
are six video display areas in the present embodiment, 
but the number of areas is not limited to this, of course. 
Further, the map window 500 shown in Fig. 3 and the 
video display window 600 shown in Fig. 5 may be dis- 
played on a same screen or may be displayed on sep- 
arate screens, i.e., on separate monitor units. Numeral 
632 represents a garbage can icon for deleting a dis- 
played camera video from a video display area. Numeral 
640 denotes a panel for camera control, which has a 
variety of buttons for camera control and which can con- 
trol pan/tilt and zoom of a selected camera. The panel 
640 may be also displayed on the same screen as the 
windows 500, 600, or may be displayed on a different 
screen therefrom. Since how to display the screens de- 
parts from the spirit of the present invention, the details 
thereof are omitted herein. 

The graphical user interface GUI of the monitoring 
system of the present embodiment will be next de- 
scribed using Fig. 6 to Fig. 1 0. The present embodiment 
is arranged so that when the drag and drop operation 
(hereinafter referred to as D & D) is performed to drag 
and drop a camera icon on the map 520, 530, ... to an 
arbitrary video display area in the video display window, 
a moving picture from a camera corresponding to the 
icon dragged and dropped is displayed on the video dis- 
play area where the icon is dropped. Fig. 6 shows a state 
upon D & D of video camera 523 to video display area 
614. During drag the shape of the mouse cursor turns 
to the shape of camera as shown in Fig. 7. whereby the 
user can recognize that the operation of drag and drop 
is under way. At this time the map management software 
413 searches the position information of the dragged 
camera for an ID number of the camera and sends the 
ID of the camera subjected to D & D to the video recep- 
tion software 412, and the video reception software 
checks pan/tilt of camera, camera name, and host name 
to which the camera is connected, from this ID and 
sends such information to the camera control client 411 
and to the map management software 41 3. Based on 
this information, the camera control client 41 1 starts net- 



work communication with the camera control server of 
the video transmitting terminal to which the pertinent 
camera is connected. After that, camera control is per- 
formed between them, and information about pan/lilt or 

5 the like of the camera is always sent from the camera 
control client 411 to the video reception software 412. 
The map management software performs updating of 
the maps stored in the video board 1 36 so as to change 
orientations of camera icons in correspondence to ori- 

10 entations of the actual cameras, to draw a scope 910 
indicating progress of display as shown in Fig. 9, and to 
draw a control pointer 920 for controlling pan/tilt, and 
zoom of camera, in the scope 910. 

This video camera display function is arranged so 

is that when a video of another video camera is already 
displayed in a video display area of the video window 
for display, the previous display video is stopped and 
the new video is displayed, thus preforming replace- 
ment of display video. 

20 The map management software is always notified 
of the information about pan/tilt of camera, etc. from the 
video reception software 41 3, so that whenever the con- 
ditions of pan/tilt, zoom, etc. of camera are changed on 
the camera control panel 640, the change is reflected 

25 immediately to the camera icons 521 , 522, 523, 531 , 
532, 533, ... Transmission of actual video is carried out 
based on a request from the video reception software 
41 2. The video reception software 412 requests the vid- 
eo transmitting software 422 of the video transmitting 

30 terminal to which the pertinent camera is connected, to 
send data of one frame through the network 100. Re- 
ceiving this request, the video transmitting software 422 
divides data of the latest frame captured into packets 
and sends them to the video reception software 41 2. 

35 The video reception software 412 reconstructs the 
frame from the packets to display it in the pertinent video 
display area and again requests transmission of video. 
Repeating this at high speed, videos at a remote place 
are transmitted and displayed through the network. This 

40 permits the moving picture of video camera to be dis- 
played on the bit map display. Display of videos of plural 
cameras can be realized by repetitively performing the 
processes of issue of video transmission request, com- 
pression of captured video, packet division, network 

45 transmission, packet receptioa frame reconstruction, 
expansion of compressed data, and display in order 
against the video transmission softwares to which the 
respective cameras are connected. 

Movement of the display position of video camera 

50 image can be realized by performing the D & D operation 
of the displayed video to a video display area desired 
as a destination, as shown in Fig. 8. Fig. 8 shows a state 
in which the video of video camera 523 having been dis- 
played in the video display area 614 was moved to 61 2. 

55 This moving function is arranged so that when another 
video camera image is already displayed in the destina- 
tion video display area, the previous display video is 
stopped and the new video is displayed therein, thus 
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performing replacement of display video. 

At this time the video reception software 41 2 clears 
the pertinent video display area and changes internal 
parameters so as to designate the D & D destination as 
an area for the video of the pertinent video camera to 
be displayed. Thereafter, the video is displayed in the D 
& D destination. This operation will never interrupt the 
logical network connection. Namely, the network once 
connected is maintained without being interrupted until 
the video display area is dragged and dropped to the 
garbage can icon 632 as detailed hereinafter For stop- 
ping the display of video camera image, the video dis- 
play area in which the video of video camera desired to 
stop displaying is displayed is dragged and dropped to 
the garbage can icon 632 in the video display window, 
as shown in Fig. 10, whereby display of the pertinent 
video can be stopped. Fig. 10 shows a state after exe- 
cution of display stop of the video of video camera 523 
having been displayed in the video display area 614. At 
this time the video reception software 41 2 clears the per- 
tinent video display area and stops issue of video trans- 
mission request to the pertinent video transmission soft- 
ware. Further, it notifies the camera control client 411 
and map management software 413 of stop of display. 
Receiving this notification, the camera control client 411 
interrupts the network connection with the video trans- 
mission terminal and clears the pertinent video display 
area. Further, the map management software 41 3 re- 
moves the scope display Irom the camera icon 523 of 
the pertinent camera to update the map. 

The software of the apparatus in the present em- 
bodiment as described above will be explained referring 
to Fig. 11. 

Fig. 1 1 to Fig. 1 3 are a flowchart to show the oper- 
ation of the whole apparatus of the present embodiment. 

Steps in the flowchart will be explained. 

S100: The map management software 413 shown 
in Fig. 2 displays the map window, for example denoted 
by 500 in Fig. 3, on the bit map display 35. 

S102: After S100, the video reception software 41 2 
shown in Fig. 2 displays the video window 600, for ex- 
ample shown in Fig. 5, on the same display 35. 

S104: After S102, the camera control client 411 
shown in Fig. 2 displays the camera control panel 640 
shown in Fig. 6 on the same display 35. 

S106: It is determined whether a camera icon dis- 
played on the map window shown in Fig. 3 is clicked; if 
clicked then the flow goes to S108; if not clicked then 
the flow goes to S112. 

Here, though the sequence of description is invert- 
ed, it is noted that the steps ol Fig. 11 are carried out by 
OS compatible with the CPU 122. In the above descrip- 
tion S100, S102, and S104are executed separately but 
the step of S1 00 may be arranged to invoke the routines 
of S102 and S104 to carry out them. 

S108: Switching of focus clicked is executed. 
Namely, the clicked camera is fixed. In other words, it is 
determined which camera is the selected camera. 



S110: A display process routine detailed hereinafter 
is started. Such a routine will be described hereinafter 
with reference to Fig. 14. 

S112: It is determined whether a desired video out 

5 of the videos displayed on the video window 600 shown 
in Fig. 5 is clicked. If clicked then the flow goes to S1 14. 
If not clicked then the flow proceeds to S1 20. 

S114: When a video is clicked, it is determined 
whether the position of a camera generating a signal of 

10 the clicked video is displayed on the map window shown 
in Fig. 3. If not displayed, the map management soft- 
ware 41 3 is instructed with an instruction for executing 
such switching of map as to display a map including the 
camera in the window shown in Fig. 3. 

is S1 1 6: Executed is switching of focus of the camera 
corresponding to the clicked video in the same manner 
as in S108. 

S1 1 8: A display movement control and stop process 
routine detailed hereinafter is started. 

20 Such a routine will be described hereinafter with ref- 
erence to Fig. 16. 

S120: It is determined whether the camera control 
panel 640 shown in Fig. 6 is clicked. When clicked, the 
flow branches to S122. 

2S S1 22: A command designated by the control panel 
is transmitted through the network 100 to the clicked 
camera. 

S1 24: It is determined whether either one of the tags 
510 to 540 of the map shown in Fig. 3 is clicked. When 

30 clicked, the flow proceeds to S126. If not clicked, the 
flow proceeds to S128. 

S1 26: The map management software 41 3 is so in- 
structed as to display a map corresponding to the 
clicked map out of the tags 51 0 to 540 among the maps. 

3S S1 28: It is determined whether there is a video des- 
ignated as a video to be displayed by D & D on the map 
displayed on the bit map display 35. If there is a desig- 
nated video, the flow goes to S 130; if not the flow goes 
toS136. 

40 S130: If there is a designated video, a packet in- 
cluding a video request signal is transmitted sequential- 
ly to a camera or to a video signal transmitting terminal 
corresponding to the video, and a video transmitted from 
the terminal requested by the packet is displayed on the 

45 bit map display 35. Such a packet is provided with an 
address on the network for designating the camera or 
video signal transmitting terminal corresponding to the 
video. 

S1 32: It is determined whether a grouping button is 
so clicked. If clicked the flow proceeds to S134. If not 
clicked the flow proceeds to c. 

S1 34: Cameras transmitting their camera videos on 
the bit map display 35 are grouped and a group icon is 
formed. 

55 S136: It is determined whether the group icon is 
clicked. If the group icon is clicked then the flow goes to 
S138. If not the flow goes to B. 

S1 38: The clicked group icon is displayed in reverse 
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video. 

S140: It is determined whether a display instruction 
of the group icon is given. If the display instruction is 
given the flow goes to a group display flow ot S142. 
Since the group display flow is not embraced in the es- 
sence of the present invention, the description thereof 
is omitted herein. If the display instruction is not given 
then the flow goes to S144. 

S1 44: It is determined whether a group deletion but- 
ton 710 is clicked. When the group deletion button 710 
is clicked, the flow goes to S146. When the group dele- 
tion button 71 0 is not clicked, the flow goes to B. 
S146: The designated group is deleted. 
The display process routine described in S110 will 
be next explained referring to Fig. 14. 

S1 50: In such a routine, first, it is determined wheth- 
er a camera icon on display is dragged. In such a flow, 
if the user continues clicking the camera icon from SI 06 
of Fig. 11 to this step, the flow goes to S151 . If the user 
releases clicking, this step is ended and the flow returns 
to the original routine. 

S151 : The mouse cursor is changed to such an in- 
dication as shown in Fig. 7 during dragging in order to 
permit the user to easily recognize that the camera is 
being dragged. 

The mouse cursor does not have to be limited to 
this example, but may be displayed in another display 
form. The point is that the user can recognize that the 
camera is under drag. 

S152: Whether the camera of the cursor shape ex- 
emplified in Fig. 7 is dropped is determined from the sta- 
tus of the click button of the mouse 128. 

It is determined whether the dropped camera is 
dropped into either one of the video display areas 610 
to 620 shown in Fig. 5. This determination is executed 
in such a way that the map management software 41 3 
compares coordinates between each area ot the video 
display areas 61 0 to 620 and a position where the cursor 
of the camera shape was dropped; if the cursor is 
dropped in an area then the flow branches to S154; if 
the cursor is dropped outside of the areas then the flow 
branches to S168 to put the mouse cursor back. Name- 
ly, the cursor is returned to the status before the camera 
is dragged in S150. 

S154: The map management software 413 deter- 
mines whether the video of the dropped area is being 
displayed. 

The map management software 41 3 performs such 
management as to always write in a table memory, in- 
formation as to which video display area 610 to 620 as 
described previously is displaying a video from which 
camera. 

If the dropped area is being displayed then the flow 
branches to S156; If not the flow branches to S158. 

S156: If a video is already being displayed in the 
dropped area, display of the video under display is 
stopped (which is equivalent to dropping it into the gar- 
bage can). 
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S15S: The video reception software 412 of Fig. 2 is 
informed of ID (identification information) of the camera 
subjected to D & D. 

S159: Next obtained from the main memory unit 124 

5 are the network address of the camera the ID of which 
was informed in S158, host name, camera name, and 
parameters indicating the status of the camera. Such 
parameters include focal length information, and data 
about a direction of white balance photography. The 

10 main memory unit 124 stores the network addresses, 
host names, camera names, and parameters indicating 
the camera status of the all image signal generators 
composing this system. 

S160: The data obtained in S159 is output to the 

is map management software 41 3 and to the camera con- 
trol client 411. 

S162: Based on the data acquired in SI 60, the 
scope display of the camera, for example, indicated by 
580 in Fig. 6, which includes the angle of the field taken 

20 by the camera and the direction in which the camera of 
the local length information is directed is displayed on 
the map. 

S164: After S162, communication with the camera 
control server 421 is started. 
2S S166: Then the video reception software 412 is in- 
structed so as to transmit a video request signal for re- 
ceiving a video signal from the selected camera, to the 
selected camera. The video reception software 412 re- 
petitively outputs such video request signals regularly 
30 after it sends the video request signal to the selected 
camera and before transmission of video signal is 
stopped in S178 described hereinafter. 

This causes the video camera to sequentially output 
image signals of each frame repetitively, whereby a 
35 moving picture is reproduced on the monitor. 

S168: The mouse cursor having been moved by D 
& D is returned to the original position. 

The display movement and stop process routine 
shown in S1 1 8 of Fig. 1 1 is next described with reference 
40 to Fig. 16 and Fig. 17. 

S170: It is determined whether the video clicked in 
S1 1 2 is continuously being clicked. If continuously being 
clicked the flow goes to S172; if clicking is already re- 
leased, this routine is ended. 
45 SI 72: The mouse cursor is changed to the shape, 
for example as shown in Fig. 7, in the same manner as 
in S151. 

S174: It is determined whether the video dragged 
by the mouse cursor is dropped into the garbage can. If 
50 dropped into the garbage can the flow goes to S176; if 
not the flow goes to S1 82. 

S176: If the video is dropped into the garbage can, 
the video display area subjected to D & D is cleared to 
display nothing. Alternatively, the display is changed to 
55 blue back. 

S178: Issue of video transmission request is 
stopped for the transmission terminal, for example a vid- 
eo camera, having been transmitting the video cleared 
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in S1 76 to the video reception software 41 2. This causes 
the communication terminal to stop communication of 
video signal. 

S180: After S178, the map management software 
41 3 and camera control client 41 1 is informed of stop of 
display on the bit map display 135, and then the flow 
moves to S192. 

S182: If the camera video is not dropped into the 
garbage can icon in S174, it is determined into which 
video display area 610 to 620 the camera video was 
dropped. 

S184: The same as S154 

S186: The same as S156 

S188: The video signal of the camera under D & D 
is displayed at a video display position where the icon 
was dropped. 

SI 90: A video signal in the area in which the video 
image of camera has been displayed heretofore is 
cleared. 

S192: The scope display of camera displayed in 
S 162 is erased. 

S194: Communication with the camera server is 
stopped. 

S196: The same as S168 

The present embodiment comprises, as described 
above , the means for dragging and dropping the camera 
symbol on the map to a video display area, thereby es- 
tablishing the logical network connection between the 
monitoring terminal and the pertinent video transmis- 
sion terminal, the means for moving a video display area 
displaying a video camera image to another video dis- 
play area by D & D, and the means for dragging and 
dropping a video display area displaying a video camera 
image to the display stop symbol, thereby disconnecting 
the logical network communication, which permits an 
observer as a user to freely rearrange the display posi- 
tions of video camera images so as to be easy to handle, 
and to select video camera images to be displayed si- 
multaneously, thereby giving flexibility to operation of 
the monitoring system. 

(Embodiment 2) 

Embodiment 2 has the same basic processes as 
Embodiment 1, but is characterized in that upon the D 
& D operation of the video camera on the map to a video 
display area in order to display a video of the desired 
video camera in the video display area of the video win- 
dow as shown by the operation in Fig. 6, if another video 
camera image is already displayed in that video display 
area, that event is detected and the display operation of 
that video is stopped. A flowchart to show the operation 
of software of this part is shown in Fig. 19 and Fig. 20. 

Further, the present embodiment also has such a 
feature that upon the D & D operation to a video display 
area expected as a destination in order to move the dis- 
play position of the video camera image as shown by 
the operation in Fig. 8, if another video camera image 



is already displayed in that video display area, that event 
is detected and the movement operation of that video is 
stopped. A flowchart to show the operation of software 
of this part is shown in Figs. 21 , 22, and 23. 
5 The steps in the flowcharts shown in Fig. 1 9 to Fig. 
23 will be described. 

S198: The same as S150 

S200: The same as S151 

S202: The same as S152 
io . S204: The map management software 413 deter- 
mines whether a video is being displayed in the dropped 
area. The map management software 413 performs 
such management as to always write in the table mem- 
ory the information as to a video of which camera is be- 
*5 ing displayed in which video display area 610 to 620 
shown in Fig. 5. If a video is not being displayed then 
the flow goes to S206; if not being displayed then the 
flow branches to S218. 

20 S206: The same as S1 58 

S208: The same as S159 

S210: The same as S160 

S212: The same as S162 

S214: The same as S164 
2S S2 1 6: The same as S 1 66 

S218: The same as S168 

S220: The same as S170 

S222: The same as S172 

S224: The same as S1 74 
30 S226: The same as S1 76 

S228: The same as S178 

S230: The same as S180 

S232: The same as S182 

35 S234: The map management software 413 deter- 
mines whether a video is being displayed in the dropped 
area. The map management software 413 performs 
such management as to always write in the table mem- 
ory, the information as to a video of which camera is be- 

40 ing displayed in which video display area 610 to 620 
shown in Fig. 5. If a video is not being displayed the flow 
goes to S236. If a video is being displayed the flow 
branches to S244. 

45 S236: The same as S 1 88 
S238: The same as S1 90 
S240: The same as S1 92 
S242: The same as S194 
S244: The same as S 196 

so 

The present embodiment is arranged so that upon 
the D & D operation of the camera symbol on the map 
to a video display area and upon the D & D operation to 
move a video display area displaying a video camera 
ss image to another arbitrary video display area, if another 
video camera image is already displayed in the pertinent 
area, such video display operation is stopped, whereby 
the video camera image already displayed can be pre- 
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vented from being erased unintentionally. 

(Embodiment 3) 

Embodiment 3 has the same basic processes as 
Embodiment 1, but has a function to switch the opera- 
tion in accordance with binary information preliminarily 
stored, upon the D & D operation of a video camera on 
the map to a video display area in order to display a 
video of the desired video camera in a video display area 
of the video window, as shown by the operation in Fig. 
6. Namely, the present embodiment is provided with two 
display modes, which are a display mode to give a high- 
er priority to a video display already displayed (called a 
previous video) and a display mode to give a higher pri- 
ority to a video display displayed newly (called a subse- 
quent video), and it is arranged to preliminarily hold in- 
formation about selection thereof and to keep the dis- 
play of the previous video but stop display movement of 
the subsequent video in the case of the former display 
mode. In the case of the latter display mode, the subse- 
quent video is displayed in a desired video display area 
and the display of the previous video is stopped, thus 
effecting replacement of video. A flowchart to show the 
operation of software of this part is shown in Figs. 24 
and 25. 

Further, the present embodiment also has a func- 
tion to switch the operation in accordance with binary 
information preliminarily stored, upon the D & D opera- 
tion to a video display area expected as a destination in 
order to move the display position of video camera im- 
age as shown by the operation in Fig. 8. Namely, the 
present embodiment is provided with two modes, which 
are a display mode to give a higher priority to a video 
display already displayed (called a previous video) and 
a display mode to give a higher priority to a video display 
displayed newly (called a subsequent video), and it is 
arranged to preliminarily hold information to select one 
of them and to keep the display of the previous video as 
it is, but stop display movement of the subsequent video, 
in the case of the former display mode. Further, in the 
case of the latter display mode, the subsequent video is 
moved to a desired video display area, and display of 
the previous video is stopped, thus effecting replace- 
ment of video. A flowchart to show the operation of soft- 
ware of this part is shown in Figs. 26, 27, and 28. 

The steps in the flowcharts shown in Fig. 24 to Fig. 
28 will be described below. 

S246: The same as S 150 
S248: The same as S151 
S250: The same as S 152 

S252: The map management software 413 deter- 
mines whether a video is already displayed in the area 
after D & D. The map management software 413 per- 
forms such management as to always write in the table 
memory the information as to a video of which camera 
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is displayed in which video display area 610 to 620 
shown in Fig. 5. If a video is not displayed the flow 
branches to S258. If a video is displayed the flow goes 
to S254. 

5 S254: The map management software 41 3 holds in- 
formation about the display mode to display the video 
camera image in the video display area. This informa- 
tion is binary information for discriminating a mode for 
stopping a subsequent video display with giving a higher 

io priority to display of previous video (called a previous 
screen priority mode) from a mode for replacing the dis- 
play image with giving a higher priority to display of sub- 
sequent video (called a subsequent screen priority 
mode) when a new camera video image is attempted to 

15 be displayed in a video display area and if another cam- 
era video image is already displayed therein, and a val- 
ue of the information is preliminarily stored. 

The processing herein, depending upon the display 
mode, branches to S270 in the previous screen priority 

20 mode or proceeds to S256 in the subsequent screen pri- 
ority mode. 

S256: The same as S156 
S258: The same as S158 
25 S260: The same as S162 
S262: The same as S164 
S264: The same as S159 
S266: The same as S160 
S268: The same as S166 
30 S270: The same as S1 68 
S272: The same as S170 
S274: The same as S172 

S276: The same as S1 74 * 
S278: The same as S176 
35 S280: The same as S1 78 
S282: The same as S180 
S284: The same as S 182 

S286: The map management software 41 3 deter- 
40 mines whether a video is already displayed in the area 
after D & D. The map management software 413 per- 
forms such management as to always write in the table 
memory the information as to a video of which camera 
is being displayed in which video display area 610 to 
45 620 shown in Fig. 5. If a video is not displayed the flow 
goes to S292. If a video is displayed the flow goes to 
S288. 

S288: The map management software 413 holds 
the display mode information about the display mode to 

50 display the video camera image in the video display ar- 
ea. This information is binary information to give a cri- 
terion for selection between the mode to stop movement 
of the subsequent video with giving a higher priority to 
display of previous image (called a previous screen pri- 

55 ority mode) and the mode to replace the video image 
with giving a higher priority to display of subsequent vid- 
eo (called a subsequent screen priority mode) when the 
camera video image is moved to be displayed in a video 
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display area and when another camera video image is 
already displayed therein, and a value thereof is prelim- 
inarily stored. 

The processing herein, depending upon this display 
mode, branches to S300 in the previous screen priority s 
mode or proceeds to S290 in the subsequent screen pri- 
ority mode. 

S290: The same as S186 
. - S292: The same as S188 
S294: The same as S190 
S296: The same as S 192 
S298: The same as S194 
S300: The same as S196 

The present embodiment comprises the treatment 
method for the cases wherein upon new video display 
by the D & D operation of the camera symbol on the map 
to a desired video display area and upon the D & D op- 
eration to move a video display area displaying a video 
camera image to another desired video display area : an- 
other camera video is already displayed in the pertinent 
video area, which is arranged to enable to select either 
one of the following two display methods, according to 
the display mode information preliminarily stored. 
Namely, the present embodiment permits one to select 
either of the two display methods, which are the display 
method to give a higher priority to a camera video having 
been displayed heretofore and thereafter to stop display 
of a camera video intended to be newly displayed or to 
be moved, and the display mode to give a higher priority 
to the camera video intended to be newly displayed or 
to be moved and to stop display of the camera video 
having been displayed heretofore, thus replacing the 
video display screen of the pertinent display area. 

Since the embodiments are arranged to perform 
network connection based on a display instruction to a 
specific position, in other words, since the network con- 
nection is not carried out based on a display instruction 
to a position other than the specific position, erroneous 
network connection can be prevented. 

By referring to the attached drawings, other embod- 
iments of the present invention will be described below. 

In accordance with another embodiment of the 
present invention, a plurality of video communication 
terminals (substantially computers having the function 
of video communication) which connect with one cam- 
era device or a plurality of camera devices are connect- 
ed to a computer network. Any of the communication 
terminals or an exclusive computer displays an image 
from a selected camera device or images from selected 
camera devices, and operates each camera device by 
remote control. Fig. 29 shows the schematic block dia- 
gram of a typical example of the plurality of video com- 
munication terminals which connect with the one cam- 
era device or a plurality of camera devices. 

In Fig. 29, camera control circuits 12-1 to 12-3 di- 
rectly control video cameras 10-1 to 10-3 to pan, tilt, 



zoom, adjust focuses, adjust exposure, and perform 
other operations, in accordance with external control 
signals. A camera input selector 14 selects which of the 
video cameras 10-1 to 10-3 to control, in order to take 
in an output signal from the selected camera (the output 
signal is normally a video signal but both a video signal 
and an audio signal when a microphone-equipped cam- 
era is used). As a communications line, for example, 
RS-232C and so forth are used, however, it is obvious 
that the present invention-is not limited thereto. 

A video communication terminal apparatus (video 
transmitter- receiver apparatus) 20 sends a control com- 
mand to a desired camera controller 12-1, 12-2 or 12-3 
through the camera input selector 14 to control one of 
the video cameras 10-1 to 10-3 connected to the select- 
ed camera controller. This video communication termi- 
nal apparatus 20 also transmits a video signal from the 
selected camera to a network, while it receives a video 
signal from the network. The video communication ter- 
minal apparatus 20 includes a central processing unit 
(CPU) 22 for controlling the whole of the apparatus 20, 
a main memory 24 : a second memory unit 26 (for ex- 
ample, a hard disc unit), a mouse 28 serving as a des- 
ignating device, and a keyboard 30. 

An input/output (I/O) port 32, which is connected to 
the camera input selector 14, supplies it with a camera 
control command. A video board 34 takes in the video 
signal from the video camera selected by the camera 
input selector 1 4, and displays various images on a bit- 
map display 35. A network interface 36 connects the vid- 
eo communication terminal apparatus 20 to a computer 
network or a communications network. The respective 
devices, namely, the CPU 22 to the video board 34 and 
the network interface 36, are mutually connected by a 
system bus 38. The network interface 36 enables the 
video communication terminal apparatus 20 to control 
a camera that is connected to a camera controller at a 
distant place by sending a control signal to the camera 
through the network, and to receive a camera control 
signal through the network. 

The camera input selector 14 selects one control 
signal line and its video output from control signal lines 
connected to the camera control circuits 12-1 to 12-3 in 
order to supply the video board 34 with the selected vid- 
eo output, and logically connects the selected control 
line to the I/O port 32. As a video signal form, for exam- 
ple, the NTSC signal is used. The video board 34 takes 
in a video signal outputted from the camera input selec- 
tor 14. The video signal taken in is displayed as a mov- 
ing-image in a predetermined window on the bit-map 
display 35. The video board 34 also has the function of 
compressing or expanding the video signal. 

In the second memory device 26, a variety of infor- 
mation related to the cameras 10-1 to 10-3 and other 
cameras connected to the apparatus 20 through the net- 
work, for example, camera position information data, 
camera figure data and so forth are stored. 

When the camera input selector 14 is connected to 
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only one of the video cameras 10-1 to 10-3, it does not 
need to be used. The corresponding camera controller 
12 may be directly connected to the I/O port 32. When 
the video camera 10 is a type in which pan, tilt and so 
forth cannot be controlled, the camera control circuit 12 
does not need to be used. When no video camera is 
used, in other words, when a video camera connected 
to another video communication terminal is operated by 
remote control to display only an image from the camera 
by using the video communication terminal apparatus 
20, it is unnecessary to use any of the video cameras 
10-1 to 10-3, any of the camera control circuits 12-1 to 
12-3 and the camera input selector 14. 

Fig. 30 shows an example ol the video display win- 
dow displayed on the bit-map display 35 when the video 
communication terminal apparatus 20 is connected to 
four video cameras. In the bottom right comer of the dis- 
play screen, buttons (camera selecting buttons) for se- 
lecting the cameras which output images to be dis- 
played within the display screen are displayed in a small 
size. The user can select one specified camera for dis- 
playing an image by selecting one button from these but- 
tons on the screen. A similar video display window is 
formed on the screen of another video communication 
terminal apparatus that receives an image from this vid- 
eo communication terminal apparatus and displays the 
received image. By operating camera selecting buttons 
on the screen at the receiving side, any of the video cam- 
eras connected to the transmitter's video communica- 
tion terminal can be selected and its output image can 
be displayed on the screen of the receiver's video com- 
munication terminal apparatus. 

As shown in Fig. 31, the camera input selector 14 
may include a camera selector 1 4A for selecting a video 
camera to be controlled and supplying the selected vid- 
eo camera with a camera control signal, and a camera 
input composer 14B for outputting a composite video 
signal from all video cameras 1 0-1 to 1 0-3 or from a plu- 
rality of selected video cameras or for outputting a video 
signal from one selected camera. In such a case, se- 
lecting video cameras to be controlled, and selecting 
video cameras from which images are inputted to the 
camera input composer 14B are independent of each 
other. To produce the composite image, there are two 
techniques, spatial composition in which images from a 
plurality of video cameras are combined on the same 
screen, and time-based composition in which images 
from a plurality of video cameras are repeatedly 
changed over on a time-axis. In this embodiment both 
techniques can be selected. 

Figs. 32 and 33 show examples of the video display 
screen corresponding to the embodiment shown in Fig. 
31 . Fig. 32 shows a condition of the screen on which an 
image from a single video camera is displayed, while 
Fig. 33 shows a condition of the screen on which a com- 
posite image of four images from four video cameras is 
displayed. In each condition, camera selecting buttons 
and a composing button for switching over the compos- 



ite image display and the single-image full-screen dis- 
play are displayed in the bottom right corner of the 
screen. 

The video communication terminal apparatus 
5 shown in Fig. 29 or 31 is connected, as terminals 40, 42 
and 44, to a computer network 46, as shown in Fig. 34. 
The terminal 40, which is a monitoring terminal operated 
by the user as an observer, can control video cameras 
connected to itself and video cameras connected to the 
10 whole terminals 42, 44 connected to the network 46. The 
terminal 40 also can display an image from any camera 
or images from any cameras. Although one monitoring 
terminal 40 is used in general, there is no problem if a 
plurality of monitoring terminals 40 are used. 
is Other terminals 42 and 44 are video transmission 
terminals for transmitting an image or images from one 
camera (or from a plurality of cameras connected to the 
terminals) to the monitoring terminals 40. Although the 
terminal 42 has a structure as shown in Fig. 29 and the 
20 terminal 44 has a structure as shown in Fig. 31 , it need 
hardly be said that the number of cameras connected 
to each terminal may be only one. In accordance with 
the number of cameras required, at least one video 
transmission terminal is used as the video transmission 
25 terminals 42 and 44. 

As the network 46, a local area network (LAN) or 
wide area network (WAN) that has a sufficient transmis- 
sion bandwidth for transmitting both digital moving-im- 
age data and a camera control signal may be used. 
30 Such moving-image data may be transmitted with the 
data compressed. Since a variety of known methods 
can be utilized in this embodiment, a detailed descrip- 
tion thereof will be omitted. 

Video boards 34 in the monitoring terminal 40, the 
35 video transmission terminals 42 and 44 (having the 
function of video capture) supply video data taken in to 
bit-map displays 35 to display images. A network inter- 
face 36 in the monitoring terminal 40 transmits control 
commands, such as a camera switching command and 
40 an image composing command, to the network 46, with 
the control commands converted into packets. These 
pieces of information are transmitted to a specified ter- 
minal in accordance with the contents of data to be 
transmitted and the necessity. The video transmission 
45 terminals 42 and 44 compress video data using their vid- 
eo boards 34 to convert it into packets, and transmit the 
packet-converted data to the monitoring terminal 40. 

On receiving the packet-converted video data from 
the video transmission terminal 42 or 44, the monitoring 
so terminal 40 expands the received data using its video 
board 34 to display an image on the bit -map display 35, 
similar to the processing of its local video signal. 

Fig. 35 is a block diagram showing the configuration 
of software used in this embodiment. In the monitoring 
55 terminal 40, a camera managing server 50, a camera 
control server 52, a camera control client 54, and video 
reception software 56 are installed, while in the video 
transmission terminals 42 and 44, camera control serv- 
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ers 52 and video transmission software 58 are installed. 

The camera managing server 50 is software to man- 
age all the cameras, connected to the network 46, which 
can be utilized by the monitoring terminal 40. The cam- 
era managing server 50 holds static information related 
to the respective cameras, such as the names of the 
respective cameras, the names of hosts (the names of 
the terminals to which the cameras are connected), the 
locations at which the respective cameras are installed, 
whether or not the panning, tilting and zooming of the 
cameras can be controlled, and dynamic information 
representing the present condition as to whether or not 
the cameras are being controlled or images from the 
cameras are being displayed, and the names of the ter- 
minals provided with the lunction of video composing 
(for example, the camera input composer 14B). The 
camera managing server 50 also manages the registra- 
tion of cameras which can be newly available through 
the network 46, the cancellation of cameras which has 
been separated from the network 46, and notifies the 
camera control client 54 of the management information 
of each camera, periodically or on demand. 

The camera control server 52 is software to control 
the cameras which belong thereto, being instructed by 
the camera control client 54. The camera control server 
52 displays the locations and directions where both the 
cameras connected to the monitoring terminal 40 and 
all the available cameras through the network 46 are in- 
stalled so that predetermined corresponding camera 
symbols overlap with the map on the display screen of 
the monitoring terminal 40. The camera control client 54 
also updates the form of the icon of each camera in real 
time, based on camera information sent from the cam- 
era managing server 50. 

The video transmission software 58 compresses an 
image taken in the terminal, and transmits the com- 
pressed image to a demanding terminal (normally, the 
monitoring terminal 40). The video reception software 
56 expands the transmitted, compressed image, and 
displays it on the bit-map display. 

Fig. 36 shows a camera display control panel that 
is displayed on the bit-map display 35 of the monitoring 
terminal 40 by the camera control client 54. A map win- 
dow 60 displays camera icons which represent the lo- 
cations and directions where the respective cameras 
are installed so that the icons overlap with a map show- 
ing the places where the cameras being controlled are 
installed. A camera display window 62 displays an im- 
age from one selected camera or images from a plurality 
of selected cameras (images from a maximum of six vid- 
eo transmitters), and includes six video display regions 
62a, 62b, 62c, 62d, 62e and 62f. A camera operation 
panel 64 is provided with various camera control buttons 
for operating the selected cameras to pan, tilt and zoom. 
On the bit-map display 35 of the monitoring terminal 40, 
a window display system that can simultaneously dis- 
play a plurality of windows operates. 

A map that shows the arrangement of seats in an 



office or store is displayed on the map window 60 , and 
on this map the camera icons 66-1 to 66-12 which cor- 
respond to the respective locations of cameras installed 
in such an office or store are displayed. The respective 
5 camera icons 66-1 to 66-1 2 are displayed at the appro- 
priate positions corresponding to the locations of the 
cameras, almost in the same directions as the cameras 
are actually directed. The cameras corresponding to the 
camera icons 66-9 and 66-1 2 cannot be externally con- 
trolled, which condition is represented by the form of 
each icon shown in Fig. 37. The camera icon corre- 
sponding to a camera from which an image is being dis- 
played on the video display window 62 is displayed by 
the camera control client 54 so that the frame of the icon 
is yellow. 

The operation of the camera display control panel 
shown in Fig. 36 and how the panel is used will be de- 
scribed below. By selecting one icon from the camera 
icons 66-1 to 66-1 2 on the map window 60 (for example, 
by clicking the icon 66-1 with a mouse), the camera cor- 
responding to the selected icon is regarded as selected, 
and the frame color of the icon 66-1 is changed to yel- 
lowish green by the camera control client 54. The cam- 
era control client 54 queries the camera managing serv- 
er 50 about information related to the camera corre- 
sponding to the selected camera icon 66-1 . The camera 
managing server 50 makes reference to the name of the 
camera queried, and confirms whether or not another 
camera connected to the same host (video transmission 
terminal apparatus 20) is used. In other words, the cam- 
era managing server 50 looks up whether or not another 
camera connected to the camera input selector 14 for 
the same host to which the selected camera is connect- 
ed is used, and notifies the camera control client 54 of 
the result. The camera managing server 50 simultane- 
ously confirms whether or not the host corresponding to 
the selected camera is provided with the camera input 
composer 14B. If the host is provided with the camera 
input composer 14B, the camera managing server 50 
notifies the camera control client 54 of its presence. 

The camera control client 54 changes each form of 
the camera icons corresponding to all the cameras con- 
nected to the same host to which the early selected cam- 
era is connected, into a form shown in Fig. 38 when the 
host is not provided with the camera input composer 
14B. The camera control client 54 changes each form 
into a form shown in Fig. 39 when the host is provided 
with the camera input composer 1 4B. The frames of the 
camera icons in both cases are changed to be yellowish 
green. While the image from the camera corresponding 
to the icon 66-1 is being displayed in one of the video 
display regions 62a to 62f of the video display window 
62, the camera control client 54 also changes the frame 
color of the video display region to yellowish green. 

For example, when the cameras corresponding to 
the camera icons 66-1 , 66-2, 66-3 and 66-4 are connect- 
ed to the same host which is not provided with the cam- 
era input composer 14B, the camera control client 54 
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changes each form ot the camera icons 66-1 , 66-2, 66-3 
and 66-4 into the form shown in Fig. 38, which form has 
been already shown in Fig. 36, and displays the frames 
of the changed camera icons in yellowish green. While 
the image from the camera corresponding to the select- 
ed camera icon 66-1 is being displayed in the video dis- 
play region 62a of the video display window 62, the cam- 
era control client 54 displays the frame surrounding the 
video display region 62a in yellowish green, as shown 
in Fig. 36. 

Fig. 40 shows an example of the screen obtained 
when the camera corresponding to the selected camera 
icon (in this case the icon 66-1 ) is connected to the host 
provided with the camera input composer 14B. The 
camera control client 54 changes each form of the cam- 
era icons 66-1 , 66-2, 66-3 and 66-4 into the form shown 
in Fig. 39, and displays the changed icon frame in yel- 
lowish green. As shown in Fig. 40, the composite image 
of images Irom four cameras connected to the host to 
which the camera corresponding to the camera icon 
66-1 is connected is displayed in the video display re- 
gion 62a of the video display window 62. Camera se- 
lecting buttons and composing buttons (as shown in 
Figs. 32 and 33) are displayed in the bottom right corner 
of the video display region 62a. In accordance with the 
selection of the camera icon 66-1, the camera control 
client 54 displays an L-shaped yellowish green frame 
along the periphery of a portion of the video display re- 
gion 62a, in which portion the image from the camera 
corresponding the camera icon 66-1 is displayed. An en- 
larged view of the portion of the video display region 62a 
is shown in Fig. 41 . 

Such displayed camera icons on the map enable 
the observer to easily grasp which cameras are con- 
nected to the same host to which the selected camera 
is connected. In addition, when the host is provided with 
the camera input composer, the display conditions of the 
camera icons are different, thus, the observer can easily 
grasp both a type of cameras by which a composite im- 
age of reduced images can be displayed and another 
type of camera by which a composite image of reduced 
images cannot be displayed. 

In order to select a camera from which an image 
needs to be displayed on the video display window 62, 
the camera icon corresponding to this camera may be 
dragged and dropped on the video display window 62. 
For example, when the selected camera is represented 
by the camera icon 66-2, the camera control client 54 
queries the camera managing server 50 about whether 
or not an image from a camera connected to the same 
host to which the camera represented by the icon 66-2 
is being displayed. 

If an image from a camera connected to the same 
host is being displayed, for example, while the image 
from the camera represented by the camera icon 66-1 
is being displayed, the camera control client 54 sends 
the host a camera switching command for switching the 
camera to the camera represented by the camera icon 
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66-2 so that the host transmits the image from the cam- 
era represented by the camera icon 66-2, and then dis- 
plays the transmitted image from the camera represent- 
ed by the camera icon 66-2 in the video display region 
5 (for example, 62a) where the image from the camera 
represented by the camera icon 66-1 is displayed. 

While the image from the camera connected to the 
same host is not being displayed, the camera control 
client 54 displays the image from the camera corre- 
w sponding to the camera icon 66-2 in the display region 
where no image is displayed. At this time, the camera 
control client 54 looks up the host that is provided with 
the camera corresponding to the camera icon 66-2, and 
if another camera connected to the host is detected, 
15 camera selecting buttons are displayed in the video dis- 
play region in which the image from the camera corre- 
sponding to the camera icon 66-2 are displayed, as 
shown in Fig. 30. 

when an image is further displayed among the video 
20 display regions 62a to 62f of the video display window 
62, or when a camera from which an image is being dis- 
played has been switched to another camera, the cam- 
era control managing server 50 updates the list of the 
names of the cameras from which images are being dis- 
2S played, and the camera control client 54 changes the 
frames of camera icons corresponding to camera 
names included in the camera name list to be yellow. 

By selecting one image Irom the images displayed 
in the video display regions 62a to 62f of the video dis- 
30 play window 62 (for example, by clicking with the 
mouse), or by double clicking any camera icon on the 
map window 60, the camera operation panel 64 is dis- 
played. With respect to each of the video display regions 
62a to 62f for displaying an image from the camera cor- 
35 responding to the activated camera operation panel, a 
red frame surrounding the region is displayed to repre- 
sent a camera control condition. The color of the camera 
icon corresponding to the camera being controlled is al- 
so changed to red. 
40 in the foregoing embodiments the display forms of 
the camera icons are changed in accordance with 
whether or not the cameras are controlled, whether or 
not the cameras are connected to the same host (video 
communication terminal apparatus 20), and whether or 
45 not the cameras are connected to the same camera in- 
put composer. However, for example, the brightness of 
the camera icons corresponding to cameras which can- 
not be controlled may be changed such that the colors 
of the camera icons are darkened, or the display colors 
so of the camera icons are differentiated. Similarly, al- 
though the camera icons corresponding to cameras 
from which images are displayed are discriminated 
based on their frame colors, the forms of the camera 
icons may be changed. The camera icons may be mod- 
55 ified by combining colors and forms so that the observer 
can easily discriminate the icons. 

Further, it is obvious that the present invention may 
be applied to a system formed by a plurality of appara- 
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tuses or an apparatus formed by a single unit. In addi- 
tion, the present invention may be applied by providing 
a system or apparatus with software. In such a case a 
storage medium in which software for using the present 
invention is stored is a main component of the present 
invention. The system or apparatus operates in a pre- 
determined manner by the software read from the stor- 
age medium thereto. 

As easily understood from the foregoing descrip- 
tion, in accordance. with the above embodiments, the 
camera icons displayed on the map enable the observer 
to easily grasp the relationship between the cameras 
represented by the camera icons and the images being 
displayed on the video display screen. 

In addition, the cameras which can be externally 
controlled to pan, tilt and zoom, and the cameras which 
cannot be externally controlled are discriminated by us- 
ing the camera icons. 

Further, the camera icons on the map enable the 
observer to recognize which camera is connected to the 
same video transmission apparatus to which the select- 
ed camera is connected, and to recognize which cam- 
eras are connected to the same camera input composer. 
Accordingly, the operability of the system is extremely 
improved. 

As described above, in accordance with the above 
embodiments, camera information can be displayed by 
using the camera icons on the map so that the observer 
can easily understand the information. 



6. An image processing apparatus comprising: 

means for supplying a video signal to a monitor 
so as to display a map indicating a setting con- 

s dition of image signal generating means; 

means for effecting display of a symbol indicat- 
ing a location of said image signal generating 
means on said map; and 
control means for effecting display of an image 

10 signal from said image signal generating 

means on the monitor in accordance with drag 
and drop of the symbol on the map. 

7. An image processing apparatus according to Claim 
15 6, wherein said image signal generating means is 

image pickup means and said symbol is an icon 
having a shape of a video camera. 

8. An image processing apparatus according to Claim 
20 6, wherein said control means is means for estab- 
lishing a network for image communication with 
said image signal generating means in accordance 
with said drag and drop. 

2S 9. An image processing apparatus according to Claim 
6, wherein said network is a local area network. 

10. An image processing apparatus according to Claim 
9, wherein said network is a bidirectional communi- 
30 cation network. 



Claims 

1. A communication apparatus characterized in that 
when received image data from an image transmis- 
sion terminal is displayed on a monitor, network 
connection with said terminal is carried out based 
on a display instruction for display on said monitor 
of the received image data from said terminal. 

2. A communication apparatus according to Claim 1 , 
wherein said display instruction is a display position 
instruction for display position on said monitor of the 
received image data from said terminal. 

3. A communication apparatus according to Claim 1, 
wherein said display instruction includes drag and 
drop. 

4. A communication apparatus according to Claim 1, 
wherein said image transmission terminal compris- 
es image pickup means. 

5. A communication apparatus according to Claim 1, 
wherein after execution of said network connection, 
an operation instruction signal of said transmission 
terminal is transmitted. 



11 . An image processing apparatus according to Claim 
6, wherein said network is a packet communication 
network. 

35 

12. An image processing apparatus according to Claim 
6, wherein said control means is means for effecting 
display of a plurality of image signals from said im- 
age signal generating means so as to be visually 

40 recognized simultaneously on the monitor, in ac- 
cordance with repetitions of said drag and drop. 

13. An image processing apparatus according to Claim 
6, wherein said supplying means is means for dis- 

45 playing said map in a switchable manner. 

14. An image processing apparatus according to Claim 
6, further having generating means for generating 
information indicating a photographing condition of 

50 said image signal generating means. 

15. An image processing apparatus according to Claim 
14, wherein said supplying means is means for ef- 
fecting display of said photographing condition on 

55 said monitor. 

16. An image processing apparatus according to Claim 
1 4, wherein said photographing condition compris- 
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es at least one of a photographing direction, a pho- 
tographing view angle, and an in-focus position of 
said image signal generating means. 

17. A communication method characterized in that 
when received image data from an image transmis- 
sion terminal is displayed on a monitor, network 
connection with said terminal is carried out based 
on a display instruction for display on said monitor 
of the received image data from said terminal. 

18. A communication method according to Claim 17, 
wherein said display instruction is a display position 
instruction for display position on said monitor of the 
received image data from said terminal. 

19. A communication method according to Claim 17, 
wherein said display instruction includes drag and 
drop. 

20. A communication method according to Claim 17, 
wherein said image transmission terminal compris- 
es image pickup means. 

21. A communication method according to Claim 17, 
wherein after execution of said network connection, 
an operation instruction signal of said transmission 
terminal is transmitted. 

22. An image processing method comprising steps of: 

supplying a video signal to a monitor so as to 
display a map indicating a setting condition of 
image signal generating means; 
effecting display of a symbol indicating a loca- 
tion of said image signal generating means on 
said map; and 

effecting display of an image signal from said 
image signal generating means on the monitor 
in accordance with drag and drop of the symbol 
on said map. 

23. An image processing method according to Claim 
22, wherein said image signal generating means is 
image pickup means and said symbol is an icon 
having a shape of a video camera. 

24. An image processing method according to Claim 
22, wherein upon said display a network for image 
communication with said image signal generating 
means is established in accordance with said drag 
and drop. 

25. An image processing method according to Claim 
22, wherein said network is a local area network. 

26. An image processing method according to Claim 
25, wherein said network is a bidirectional commu- 
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nication network. 

27. An image processing method according to Claim 
22, wherein said network is a packet communica- 

s tion network. 

28. An image processing method according to Claim 
22, wherein upon said display, a plurality of image 
signals from said image signal generating means 

10 are displayed so as to be visually recognized simul- 
taneously on said monitor, in accordance with rep- 
etitions of said drag and drop. 

29. An image processing method according to Claim 
is 22, wherein said supplying comprises displaying 

said map in a switchable manner. 

30. An image processing method according to Claim 
22, further having generating information indicating 

20 a photographing condition of said image signal gen- 
erating means. 

31. An image processing method according to Claim 
30, wherein said supplying is means for effecting 

25 display of said photographing condition on said 
monitor. 

32. An image processing method according to Claim 
30, wherein said photographing condition compris- 

30 es at least one of a photographing direction, a pho- 
tographing view angle, and an in-focus position of 
said image signal generating means. 

33. A communication apparatus comprising: 

35 

display means for effecting display of a video 
from a video transmission terminal connected 
to a network in a display area of a monitoring 
terminal; and 

40 means for controlling logical network connec- 

tion with said connected video transmission ter- 
minal in accordance with execution of drag and 
drop operation of the video displayed in said 
display area to a predetermined symbol. 

45 

34. A communication method comprising: 

effecting display of a video from a video trans- 
mission terminal connected to a network in a 
so display area of a monitoring terminal; and 

performing drag and drop operation of the dis- 
played video to a predetermined symbol, there- 
by controlling network connection with said 
connected video transmission terminal. 

55 

35. A communication apparatus according to Claim 33, 
wherein said predetermined symbol is a display 
stop symbol. 
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36. A communication apparatus according to Claim 35, 
wherein said controlling means is means for stop- 
ping said video display in accordance with drag and 
drop thereof to said display stop symbol. 

5 

37. An image processing method according to Claim 
22, wherein said steps are stored in a medium so 
as to be read by a computer. 

. . . . . 10- 
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